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Abstract 



This article deals with the starting and stopping problem under Knightian 
> ' 

00 ' uncertainty, i.e., roughly speaking, when the probability under which the future 



evolves is not exactly known. We show that the lower price of a plant submitted 
to the decisions of starting and stopping is given by a solution of a system 
of two reflected backward stochastic differential equations (BSDEs for short). 



■ We solve this latter system and we give the expression of the optimal strategy. 

Further we consider a more general system of m (m>2) reflected BSDEs with 
interconnected obstacles. Once more we show existence and uniqueness of the 
solution of that system. ■ 
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0. Introduction: Wc first introduce through an example the standard starting and 
stopping (or switching) problem which has attracted a lot of interests during the last 
decades (see the long list of bibliography and the references therein) . 

Assume that a power plant produces electricity whose selling price, as we know, 
fluctuates and depends on many factors such as consumer demand, oil prices, weather 
and so on. It is also well known that electricity cannot be stored and when produced 
it should be almost immediately consumed. Therefore for obvious economic reasons, 
electricity is produced only when there is enough profitability in the market. Other- 
wise the power station is closed up to time when the profitability is coming back, i.e., 
till the time when the market selling price of electricity reaches a level which makes 
the production profitable again. Then for this power station there are two modes, 
operating and closed. Accordingly, a management strategy of the station is an in- 
creasing sequence of stopping times 5 — (r„)„>o (tq — and for any n > 0, r„ < r„+i). 
At time t„, the manager switches the mode of the station from its current one to the 
other. However making a change of mode is not free and generates expenditures. 

Suppose now that we have an adapted stochastic process X = {Xt)t<T which 
stands for either the market electricity price or factors which determine the price. 
When the power station is run under a strategy S = (t„)„>o, its yield is given by 
a quantity denoted J{S) which depends also on X and many other parameters such 
as utility functions, expenditures, ... . Therefore the main problem is to find a 
management strategy 5* — {r*)n>i such that for any S we have J{S*) > J{S), i.e. 
J{S*) — supg J{S). Once determined, the strategy 6* gives the optimal way of running 
the power plant and, as a by-product, the real constant J{5*) is nothing else but the 
fair price of the power plant in the energy market. 

The two-mode starting and stopping problems attracted a lot of research activity 
(see e.g. [1, 2, 3, 7, 8, 10, 11, 12, 13, 16, 18, 19, 22, 25, 26, 29, 28, 30], ... and the 
references therein). 

Recently, Hamadene and Jeanblanc [18] consider a finite horizon two-modes when 
the price processes are only adapted to the filtration generated by a Brownian motion. 
Porchet et al. in [25] have considered the same problem with exponential utilities and 
allow for the manager the possibility to invest in a financial market. Djehiche and 
Hamadene [8] studied also this problem but the model integrates the risk of default of 
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the economic unit. Let us also mention the work by Hamadene and Hdhiri [19] where 
the set up of those latter papers is extended to the case where the price processes 
of the underlying commodities are adapted to a filtration generated by a Brownian 
motion and an independent Poisson process. 

Finally note that this two-mode switching problem models also industries, like 
copper or aluminium mines,..., where parts of the production process are temporarily 
reduced or shut down when e.g. fuel, electricity or coal prices are too high to be 
profitable to run them. A further area of apphcations includes ToUing Agreements 
(see Carmona and Ludkovski [5] and Deng and Xia [7] for more details). 

The natural extension of the two mode starting and stoping problem, is the case 
where there are more than two modes for the production. This problem has been 
recently considered by several authors amongst we can quote Carmona and Ludkovski 
[5], Djehiche et al. [9] and Porchet et al. [26]. 

The studies quoted above, however, assume that future uncertainty is character- 
ized by a certain probability measure P over the states of nature. This turn out to 
assume that the firm is in a way certain that future market conditions are governed 
by this particular probability measure P. The notion of Knightian uncertainty intro- 
duced by F.H. Knight [21] assumes that it is not granted that future uncertainty is 
characterized by a single probability measure P but other probabilities P", u e U, 
are also likely. Usually those probabihties are supposed not far from P. This 
notion will be defined later. Therefore one of the main issues is, e.g., related to the 
fair price of the power plant in the market. If this latter quantity does not exist what 
could be the lower price of the plant in accordance with the sur-replication concepts 
well-known in mathematical finance. 

To make things more clear suppose that the process X is the price of electricity in 
the energy market and assume that its dynamics is given by the following standard 
differential equation: 

dXt = Xtindt + atdBt),t < T and = x > 

where {Bt)t<T is a Brownian motion, r = {rt)t<T is the spot interest rate and finally 
{(Jt)t<T the volatility of the electricity price. So if the parameters r and a are known 
then the price of the power plant is just given by sup^ J(5). However usually it 
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happens that the process r is not precisely known. We just have on it some confidence 
i.e. we know that P — a.s., for any t G [0,T],rf G [— /t, k] where k is a positive real 
constant which describes the degree of Knightian uncertainty (/t-ignorance in the 
terminology of Chen- Epstein (see [6])). Therefore possible dynamics of the electricity 
price are the following: 

dXt = Xtiutdt + atdBt),t < T and = a; > 

where B is once more a Brownian motion and u = {ut)t<T is an adapted stochastic 
process which takes its values in the compact set [—k, k] . In this case, things go on 
like incompleteness in financial markets, we are just able to speak about the lower 
price of the power plant which is given by the quantity: 

J* = supinf J(5,ii), (0.1) 

5 " 

where J{S, u) is the yield of the power plant when run under the strategy 5 and 
the future evolves according to the probability for which S is a Brownian motion. 
Mainly in this work we aim at evaluating the quantity J* and providing a pair {5*, u*) 
such that J* = J{S\u*). 

So in order to tackle our problem, using systems of refiected BSDEs with oblique 
reflection, we first provide a verification theorem which shapes the problem under 
consideration. We show that when the solution of the system exists it provides an 
optimal strategy {S*, u*) of the switching problem under Knightian uncertainty. Then 
we deal with a general system of m (m > 2) reflected BSDEs with oblique reflection 
for which we provide a solution. As a by-product, we obtain that the veriflcation 
theorem is satisfled and therefore the switching problem solved. Further we address 
the difficult issue of uniqueness of the solution of the general system. Basically it 
turns out that the solution of that system can be characterized as an optimal value 
for an appropriate switching problem. Henceforth it is unique. 

The idea of using refiected BSDEs in starting and stopping problems with two 
modes appeared already in a previous work by Hamadene & Jeanblanc [18]. Then 
there were several works on this subject using the same tool (see e.g. [5, 26]). In 
[5], the authors consider the multi-mode starting and stopping problem. However 
they left open the question of the existence of the solution of the system of refiected 
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BSDEs with oblique reflection, associated with the multi-state switching problem. 
This question of existence/uniqueness is solved by Djehiche et al. in [9]. Independent 
of our work, very recently Hu & Tang [20] considered a quite more general, w.r.t. 
the one introduced in [5], multi-dimensional reflected BSDE with oblique reflection. 
They show existence and uniqueness of the solution. However their framework is still 
somehow narrow since, due to their techniques based on the use of local times and 
Tanaka's formula, the assumptions they put on the data are rather stringent. 

In this paper, using the notions of Snell envelope of processes [14, 17] and the 
notion of smallest g^-supermartingales introduced by Mingyu & Peng [23] we provide 
new results, w.r.t. the ones of [20], on existence/uniqueness of the solution for the 
system of reflected BSDEs with obhque reflection. 

This paper is organized as follows. In Section 1, we introduce the problem and 
give some properties of the model. The quantities J{5, u) are expressed by means 
of solutions of standard BSDEs whose coefficients are not square integrable. Then 
we provide a verification theorem which shapes the problem via systems of refiected 
BSDEs with interconnected obstacles. The solution of the system provides the pair 
{5*, u*) which achieves the sup inf in (0.1). In Section 2, we consider a more general 
system of refiected BSDEs, and show the existence of its solution. Finally in Section 
3 we characterize the solution as the optimal reward over some appropriate set of 
strategies. This implies uniqueness of the solution of the system. ■ 

1 The starting and stopping problem 
1.1 The model 

Throughout this paper (Q, JF, P) will be a fixed complete probability space on which 
is deflned a standard rf-dimensional Brownian motion B = (-Bt)o<t<T whose natural 
flltration is {J-'f = ^{Bs, s < t})o<t<T- 

Let F = (J^t) 

o<t<T be the completed flltration 
of {J-^)o<t<T with the P-nuU sets of JF, hence {J-'t)o<t<T satisfles the usual conditions, 
i.e., it is right continuous and complete. Furthermore, let: 

- be the cr-algebra on [0, T] x Q of F-progressively measurable sets ; 

- H^'^ be the set of 7^- measurable and 1?' -valued processes rj — {rit)t<T such that 
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E[J^\rjs\Pds]<oo{p>l); 

- be the set of P-measurable, continuous, i?-valued processes r] = {rit)t<T such 
that -E[supj<j. < oo ; we denote by A the subset of S"^ which contains 
non-decreasing processes {Kt)<T such that Kq = 0; 

- for any stopping time r e [0,T], %- denotes the set of all stopping times 9 such 
that r <e <T, P - a.s. 

- the class [D] be the set of T'-measurable roll (right continuous with left limits) 
processes V — {Vt)t<T such that the set of random variables {Vr,T e %} is 
uniformly integrable. 

- for any stopping time A, is the conditional expectation with respect to J^x, 

Let us now fix the data of the problem. 

(i) Let X = (Xt) 

o<t<T be an T'-measurable process with values in IR'^ such that 
each component belongs to 5^ (then X is continuous). It stands for factors which 
determine the market electricity price. 

(ii) For i = 1, 2, let V'i : {t, x) e [0, T]x M'^ ^ ipi{t, x) e M, be Borelean functions 
for which there exists a constant C such that \ipi{t, x)\ < C{l + \x\), i — 1,2. t/ji (resp. 
■02) represents the utility function for the power plant when it is in its operating (resp. 
close) mode. Actually in a small interval dt, when the power plant is in its operating 
(resp. closed) mode it generates a profit equal to '^i{t,Xt)dt (resp. '4>2{t,Xi)dt). 

(in) The switching of the power plant from one mode to another is not free. 
Actually if at a stopping time r, the plant is switched from the operating (resp. 
closed) mode to the closed (resp. operating) one, the sunk cost is equal to V9i(r, X^) 
(resp. (/92(t, X^)) where the non-negative functions (pi,<f2 '■ {tjx) G [0,r] x M'' i-^ 
(pi{t,x),ip2{t,x) G iR"*" are continuous and linearly growing, i.e., there exists a con- 
stant C such that \(pi(t. x)\ < C(l + \x\), i = 1,2. Additionally they verify (pi{t, x) + 
(p2{t,x) > for any {t,x) e [0, T] x R''. This latter requirement means that it is not 
free to make two instantaneous switching at any time t <T. 
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(iv) Let S = (r„)„>o be an admissible management strategy of the plant, i.e., the 
r„'s are F-stopping times such that r„ < r„_|_i (tq = 0) for any n > and lim„^oo Tn = 
T, P-a.s.. The set of all admissible strategies will be denoted by V. We assume that 
the power plant is in its operating mode at the initial time t = 0. Therefore T2n+i 
(resp. T2n) are the times where the plant is switched from the operating (resp. closed) 
mode to the closed (resp. operating) one. 

In the conventional model, i.e., if we know that the future will be governed by 
the probability measure P the mean yield of the power plant when run under the 
strategy 5 = {rn)n>o is given by : 

J{S) ^ J%\t,Xt)dt - A't.}, 

where is the expectation under the probability measure P, 

[T2n,T2n+l 

){t) + i>2{t, x)l[r2n+l,T2n+2){'t)\', 

' 5 A r"-° (1-2) 

A = Y1 ['^l('^2n+l,^r2„+i)l{r2„+i<t} +</'2(r2„+2,^r2„+2)l{r2n+2<^}J■ 
r^>0 

Therefore the price of the power plant in the energy market is just sup^gp •^('^)- 

Knightian uncertainty amounts to suppose that we are not sure that the future will 
evolve under the probability P but other probabilities P", u eU (which we will precise 
later) are also hkewise. However we will suppose that those possible probabilities P" 
are not far from P in the sense that P and P" are equivalent. Actually we will assume 
that: 

rfP" A f'^ 1 

^ = L^ = exp(y^ h{s,X.,Us)dBs--j^ \h{s,X.,Us)\''ds) 

where: 

[i] u = {ut)t<T is an "P-measurable process with values in some compact set U. 
Hereafter u will be called an admissible control and the set of those controls will be 
denote by U. 

(ii) b : (t, X, u) G [0, T] x C([0, T],R'')xU^ b{t, x, u) e iR^ is a Borel measurable 
and bounded function. Moreover we assume that for any {t,x), the mapping u e 
U I— > b{t,x,u) e M'' is continuous and for any u & U the process {b{t, X.,Ut))t<T is 
P-measurable. 
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Note that since the function b is bounded then the random variable LJ^ has mo- 
ment of any order, i.e., for any p > 1, E[{L1^y] < oo and if we set, for t < T, 
Lt = E[L}^\J^t] then the process {L'^)t<T satisfies the following standard stochastic 
differential equation: 

= ^b(t, X, Ut)dBt, t<T; = 1. 

As previously mentioned, if the future evolves according to the probability law 
P", u then the fair price of the power station in the energy market is given by: 

J{u) = sup J{S, u) 
Sev 

where 

J{5,u) = E^{ J%\t,Xt)dt - A't}, (1.3) 

and is the expectation under P" and ip^, are defined by (1.2). However all the 
probability measures are likewise therefore the selling lower price of the power plant 
in the energy market is given by: 

J* = sup J{5); J{5) - inf J{5, u). (1.4) 

Actually the quantity J* stands for the optimal yield of the power plant in the worst 
case of evolution of the future. Therefore the problem we are interested in is to asses 
the value J* and to find a pair {6*, u*) such that 

J* = J{S*) = J{S*,u*) = inf J{5*,u). 

We note that, for any -u, J{5*,u) > J*. However, for an arbitrary 5, in general we do 
not have J{S,u) > J{S,u*). □ 

Remcirk 1 In the particular case where the process X is the solution of the following 
standard functional stochastic differential equation: 

dXt = a{t, X.)dt + (7(t, X.)dBt, t<T andXo = x (1.5) 

with appropriate assumptions on the functions a and a in order to guarantee existence 
and uniqueness of the solution of (1.5), then thanks to Girsanov's Theorem we have: 

dXt = (a(t, X.) + a{t, X.)b{t, X.))dt + a{t, X.)dB^, t<T andXo^x 

where = Bt — J^b^s, X.,Us)ds,t < T, which is well known that it is a Brownian 
motion under the probability measure P". ■ 
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1.2 Properties of the model 

We are going to simplify the problem and to show that we can focus only on a 
restricted set of strategies which satisfy appropriate integr ability conditions. So for 
any admissible strategy 5 — {Tn)n>G £ let us recall (1.2), (1.3) and (1.4). Note that 
do not depend on u and is rcll. 
Now for p > 1 let us set 

Vp^{5e V, such that sup£;"[(A^)^'] < oo}; V = Up>iPp. 

It follows that if 5 E T> — T>i, we have J{S) — — oo since the process {'^^{t,Xt))t<T 
belongs to V'{dt x dP") due to the facts that {^i{t, Xt))t<T, ^ = 1,2, belongs to H'^'^ 
and that the random variable Lj^ has moments of any order with respect to the prob- 
ability measure P. As a consequence, in our objective to evaluate and characterize 
the quantity J* = supg^-,:,miu^K J{5,u), we can discard the admissible strategies 5 
which do not belong to T>i. 

Next we introduce the Hamiltonian of the problem which is defined by: for any 

{t,x,u,z) e [o,r] X c([o,r],iR*^) xu xM"^, 

H(t, X, u, z) = zb(t, X, u) and if*(t, a;, z) = inf H(t, x, u, z). 

Since 6(t, a;, u) is bounded then the function H and H* are uniformly Lipschitz w.r.t. 
z. Additionally, thanks to Benes's selection Theorem, there exists a measurable 
function u* : (i, x, z) e [0, T] x C([0, T], iR*^) x R"^ ^ u*{t, x,z) eU such that: 

H*{t,x,z) = [zb{t,x,u)]u=u*{t,x,z)- 

We are now going to express the yields J(5, u) by the means of solutions of BSDEs 
whose coefficients are not square integrable. Actually we have: 

Proposition 1.1 {i) Let 5 E Vi and u E U, then there exists a unique pair of 
processes (F"^'", Z^'^) such that the process (r^'"-A^)L" is of class [Dj, iZf-^pds < 
oo a.s., and finally for any t <T we have: 

r/'-= ^{^|;\s,X,) + H{s,X,,Us,Zf'-))ds- Z^'' dB, - {A'^ - 4) 
Jt Jt 
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Moreover for any t <T we have: 

yS,u ^ E^[j%\s, X,)ds - (A* - Al)\Tl 

(ii) For any S e V, there exist q > 1 and a unique pair of processes {Y^, Z^) such 
that: 

e\ sup + ( r \Z^fdsy/^} < oo; 
< '*<^^ ^ (1.6) 

y/ = / X,) + H*{s, X, Zl))ds - I ZfdBs - {A't - At),t < T. 

K Jt Jt 

Moreover for any t < T , Yf = cssinfygz^l^'^'". In particular, J (5) — Yq and the 
optimal argument is {u*{t, X, Z^))t<T- 

Proof : (i) Let 5 be a strategy which belongs to Vi and u ElA. Therefore we have 
E[L^A^j] = E^'lA^j,] < oo. Besides the process (LJ'^/'''(t,Xt) )t<T belongs to Li(rft(g)rfP). 
Henceforth thanks to the result by Briand et al. ([4], Theorem 6.3, pp.18) related to 
solutions of BSDEs whose coefficients belong only to L^, there exists a unique pair of 
processes f^'" of class [D] and Z^'"" such that E[{J^ iZf-'^pds)^] < oo, for any 7 e]0, 1[, 
which satisfy: 

y/'" = -L^A^ + j^^ L''^ip\s, Xs)ds - Z^'^dBs, t < T. 
Let us set now for i < T, 

yS,u A Y^S,u^^uyl ^ ^S. zf^u A _ x, «,)]■ 

First note that y*'" is finite since A^ < 00, P-a.s. due to the equivalence of the 

probability measures P and P". Moreover /(f I Zf'" 1 < 00, P-a.s.. Finally the 
process (y^'" — A^)L^ is just y^'" which belongs to class [D]. Using now Ito's formula 
for y''" we get: Vt < T, 

y/'" = r(i^\s, X,) + H(s, X„ Us, Zl'^))ds - r ZfdBs - {A'r, - Al). 
Jt Jt 

It remains to show that Y^'''^ is just the conditional payoff after t. Actually let A„ be 
the following stopping time: 

A„ = inf{t > 0, /* iZf'^pds > n} A T. 
10 



Therefore 

^ JtAXn ' 

But the sequence of stopping times (A„)„>o converges to T and L"(y''" — A^) belongs 
to class [D], therefore Y^^ - A\^^ -A^j, in L^(dP"). Besides the second term in the 
conditional expectation converges also in L^{dP'^) to ijj^{s, Xs)ds + A^. It follows 
that: 

yS,u ^ j^^8^s,X,)ds - {A'r, - Al)\Tt], yt < T, 

which is the desired result. 

Let us now focus on {ii). Let 5 be a strategy of "D', therefore there exists p > 1 
such that snp^^y E^[{Aj,y] < oo. As the moments of any order of {Lj,)~^, u &U, 
exists then there exists q > 1 such that < oo. Now using once more the 

result by Briand et al. ([4], Theorem 4.2, pp.11) related to BSDEs in L« {q e]l,2[) 
there exists a pair of processes {Y^, Z^) such that: 

E{sup\Y,'\'^ + {r \Z'j'dsy}< oo; 

^ t<T Jo ^ 

y/ = -A^T + r{^\s, Xs) + H*{s, Xs, Zl))ds - r ZfdB,, t < T. 
K Jt Jt 

Now let us set Y^ ^Y^ + A^ then the pair (Y^, Z^) is solution of the BSDE (1.6). 

Next for any t < T, H*(t, X, Zf) = H(t, X, Zf, u*(t, X, Zf)) and since (y'^-A'^)L"* 
belongs to class [D] (note that u* — {u*{t, X, Zf))t<T) then thanks to (i) we have: 

y/ = E-'{j%\s,X,)ds - (^^ - Al)\Tt} - Y^^'^'-yt < T. 
Next let ueU. Then for any t < T, 

r/-y/'" = r{H*{s,x,zl)-H{s,x,,Us,zl'^))ds- r{zl-zl'^)dB, 

Jt Jt 
= j\H*{s, X, Zl) - H{s, X„ Us, Zl))ds - j\zl - Z'^^^)dB:. 

As {Y^-Y^'^)L'' is of class [D] and since H*{s, X, Zl)-H{s, X^, Us, Z^) < therefore, 
arguing as previously by using appropriate stopping times, we obtain Y^ — Yf'^ < 
for any t <T. Henceforth it holds that: 

Y,'^essmi^^uYt''\t<T, 
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and the optimal argument is u* = {u*{t,X, Z^))i<t- ■ 

We are now going to prove that the suprema of J{5) over Vi and V are the same. 
Actually we have: 

Proposition 1.2 sup J {5) = sup J{5). 

Proof: For any 5 e "Di and any n, let 5" = {'^i}i>'o-i where 

A„^infO>0:A^>n}AT; ^ ( ^J' ^ 

[ T, it Ti > A„. 

It is obvious that the stopping times A„ t T, and < n and then 5" e X>'. 
For any u eU, 

J{5,u) ^ £ tlj\t,Xt)dt - A^t} < E''[j^il)\t,Xt)dt-A^^} = Jn{^u). 
Note that 

rT 



<2{£;'^[y^'max|V',(t,X,)|^dt]}'^'{£;"[(r-A„)]}'^'' 

where p g]1,2[ and g is its conjugate. But the right-hand side converges uniformly 
in M G W to as n — cxD since the processes -^t))t<T belong to I/y have 

moments of any order and {h{t, X, Ut))t<T is a uniformly bounded process. Therefore 
we have: 



lim sup \ Jn{8,u) — J{5^,u)\ — 0. 



It follows that: 



J{5,u) < Jn{5,u) = Jn{5,u)-J(5'',u) + J{5'',u) < sup \Jn(5,u)-J(5'',u)\ + J(5'',u). 
Minimizing now both hand-sides over u &U, we get: 

J (6) < sup|J„(5,'u) - J{6",u)\ + J{6") < sup \Jn{S,u) - 7(5",^) I + sup J{S). 
Finally taking the limit as n — > oo to obtain the desired result. ■ 
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1.3 A verification theorem. Connection with refiected BS- 
DEs 



In order to tackle the problem which is described in the previous part we are going to 
use the notion of systems of backward stochastic differential equations with reflecting 

barriers which we introduce now. 

Let us consider the following two dimensional reflected BSDEs: 



' Y\Y^ e 5^ Z\Z^ e n^''^ and K\ e A, 



ds — 



(1.7) 



= [Ms, Xs) + H*{s, X,, ZD] ds - Z^dB, + Kl- K^, 
> Y^ - X,)- [y/ - + Xi)\dK\ = 0; 

[ > Yl - ^t, Xt); [y/ - y/ + Mt, Xt)]dK^ = o. 

For the moment we suppose that the processes Y\ Z\ K\ i = 1,2 exist. We leave 
the well-posedness and computation of (1.7) to next section. Our main result of this 
section is the following theorem. 

Theorem 1.3 Assume (pi(t,x) + (p2(t,x) > 0. Then Yq = sup^^j^^^infueu Ji(^,u) . 
Moreover, the optimal strategy 6* which belongs to Vi is given by Tq = and, for 
n = 0, 

= inf > r*„ : y/ = Y,' - cp,{t, X^)} A T; 
r*„+2 = inf > r*,+i : y/ = y/ - ^t, X,)} A T. 

Proof. First let us point out that thanks to Proposition 1.2, it is enough to show that 
Yq — supg^jj, iniueu Ji^, u)- So let 5 — (t„)„>o G V (tq = 0) and let us show that we 
have Yfj- > y^f . To this end, we deflne for t < T: 

_ 00 



n=0 

oc 



n=0 



Note that there is no problem of deflnition of the processes Y^ and Z^ since the series 
are convergent (at least pointwise). Besides Y^ is rcll and uniformly square integrable 
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and belongs to IH}''^ for any admissible strategy 5. Moreover we have: 



y — 



+ r U\s,X,) + H*{s,X,,ZD]ds+ r ZldB, 
Jo ^ Jo 



y2 _^ 

T2 ' 



T2 r 

n 



(is 



/ 



T2 

n 



Z.^dS, + Kl- Kl 



ds 



Jo 



ZtdB, 



Ms,Xs) + H*is,X,,Z^^ 

-ipi{n,Xr,)l{r^<T}+ r [tP\s,X,)+H*{s,X,,Zi) 

J 

> - V?2(T2,^^)l{r2<T} - ^l(ri,X^Jl{^,<T} (1-9) 

+ r r zidB,. 

Jo ^ ^ Jo 

Repeat the procedure as many times as necessary we get: for any n > 0, 



fe=0 

+ [ij\s, X,) + H*{s, X, Zl)\ds - ZldB, 

Taking now the limit as n — > oo and noting that t„ t T, we obtain: 



^^o^ > /' W{s, Xs) + X, Zl)\ds - r ZldB, - A. 
Jo ^ ^ Jo 

Following the same arguments we get, for any t <T, 

y/ > W{s, X,) + H*{s, X, ZD]ds - \J ZldB, - [Mr - A'^ 



5 

T- 



(1.10) 



Here let us emphasize that up to now we did not use the fact that the strategy 8 
belongs to T>' but only the fact that b is admissible. This remark will be useful later. 
At this level we need b to be an element of T>' . Actually let us consider the process 
defined in (1.6). Then for any t <T we have, 



y/-y/ > 



H*is,x,zf)-H*{s,x,zD 

> f {Zl - Zl)dB, 



ds 



{Zl - Z^dB, 



(1.11) 



where B, = B_ — /q 75^5 with 



A H*is,X,ZD-H*is,X,ZD ^ 
7s = TT^ ^[zl-zl^o] 
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which is a bounded P-measurablc process since the mapping z i— ^ H*{t, X, z) is 
uniformly Lipschitz. Therefore, thanks to Girsanov's Theorem, i? is a new Brownian 
motion under a new probabihty measure P equivalent to P whose density w.r.t. P 
is given by L which satisfies: 

dLt = LtjtdBt, Lo = l. 

Note that since the process 7 is bounded then the random variable Lt has moment 
of any order w.r.t. P. Next we know that there exists a real constant q > 1 such that 
£'[(/o^{|Zfp + |Zfp)ds)^/2] < 00, then there exists another real constant q' > 1 
such that E[(/o^{|Zf |2 + |Zf |2)ds)'''/2] < 00. Therefore the stochastic integral /o(Zf - 
Zf)dBs is a actually a martingale. Going back now to (1.11), taking expectation w.r.t. 
P we obtain that Yf — Yf>0 P-a.s. and then also P-a.s. since the probabilities are 
equivalent. As this inequality is valid for any t <T and the processes and Y^ are 
rcll then P-a.s., for any t <T, F/ >Y^^ = essinlueuYt'^ ■ 

It remains to prove S* — (t*)„>o is optimal. First let us show that S* is admissible, 
i.e., P-a.s. limn-*oo'Tn — T. Actually let u be such that Zim„_>ooT*(a;) = < T. 

As the processes Y^, y^, Xt))t<T and ((/?2(^, Xt))t<T are continuous then for any 

n > we have: 

^kj^) = ^kj^) - MrL^ii^):X^,^Ju)) and 

We now let n tends to +00 and we obtain 

Y^,{uj) = Y^.{uj) - 99i(r*(a;),X,*(a;)) and Y^.{uj) = - 992(r*(a;), X,.(a;)) 

which obviously implies that i^-i{t*{ijj),Xt*{uj)) -\- </?2(T*(a;), = which is 
impossible. Therefore P[uj : hm„__>oo T*(a;) < T] = and the strategy S* is admissible. 
On the other hand, note that by definition (y^, y^) are continuous processes, then 

Y,\ = y^ - (^iK, ^.*)1k<t}; y,] = y,\ - <p,{r;, x.|)1k<t}- 

Moreover, 

^1 ^2 ^1 
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Therefore the inequaUties (1.8) and (1.9) become equaUties. Following similar argu- 
ments and since S* is admissible we have: for any t <T, 

Yf = [i^'\s,Xs) - H{s,X„ Z';)]ds - £zfdB, - [A'j: - Af]. 

Writing the equation for i = we deduce that £'[(74j!")^] < oo since Y^* is uniformly 
square integrable and Z^* belongs to H'^''^. It follows that there exists a constant 
p e]l,2[ such that sup^^y E^'KA^tT] < ^ and then 5* belongs to V. By the well- 
posedness of (1.6) for elements of V, we get Y^f* — Yf* since Y^* and Z^* are adapted 
processes. In particular, Yq — Yq* — Yq* — supg^^,, Yq — supg^j), inf„gjY J{^, u) — 
sup^gx) inf J{5,u) — J*. Additionally 5* is optimal in I>i since P' C I>i. □ 

Remcirk 1.4 ; Thanks to Proposition l.l-(ii), the control u* — {u*{t, X, Z^))t<T 
combined with the strategy 5* satisfy: 

= y^f* = Yf = J {6*, u*) = inf J{S*,u) = sup inf J{S, u). 



2 High Dimensional Reflected BSDEs: Existence 

As stated in Theorem 1.3, the solution of our original problem turns into solving the 
system of two reflected BSDEs (1.7) whose obstacles are inter-connected and depend 
on the solution. Therefore in what follows we are going to deal with general systems 
of reflected BSDEs such that (1.7) is just a particular case. Actually let us consider 
the following general system of RBSDEs: for j = 1, • • • , m, 

' Y^ G S\ Z^ e n^''^ and G A, 

' ^ + It^ ■ ■ ■ ' ^^^"^^ " / ^^"^^^ + " ' ^2.1) 

Yt^ > max hj,,{t, Yi) ; [y/ - inax /i,- ,(i, y/)]dX/ = 0; 

where Aj C {1, • • • , m} — {j}, and the coefficients hj^i can depend upon uj. For 
simplicity we denote = O^ti ' ' ' ' ^t™)' similarly for other vectors. We empha- 
size that here Aj can be empty and if so we take the convention that the maximum 
over the empty set, denoted as 0, is — oo. Then in this case Y^ has no lower barrier 
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and then we take = 0. Consequently, satisfies the following BSDE without 
reflection: 

= + ^^^"^^ " ^^"^^^ ^ - 

Also, for any j we define 

hj,j{t,y)^y. (2.2) 
We note that the of the solution of (2.1) satisfies 

y/> max %(i,y/). (2.3) 
ieAjU{j} 

Remark 2.1 T/ie system we consider in (2.1) is appropriate for multi- dimensional 
switching problems when from one mode j of the plant we are allowed to switch only 
to the modes which belong to Aj. ■ 

Throughout this section we shall adopt the following assumption. 

Assumption 2.2 For any j — 1, - ■ ■ ,m, it holds that: 
(i)E[r sup |/,(i, y^,0)|2dt+|e,f} <oo. 

(a) fj{t,^,z) is uniformly Lipschitz continuous in {yj,z) and is continuous and 
increasing in yi for any i ^ j ■ 

(Hi) Fori G Aj, hj^i(t,y) is continuous in (t,y) increasing iny, and hj^i{t,y) < y. 
Moreover, if j2 G Aj^, ■■■ ,jk& ^jk-i^h ^ ^jk> M ^.i^'V V, denote 

Vk = hj^A^, y), yk-i = hj^_,j^{t, y^), • • • , = hj^j^{t, ^2)- 

Then we have 

yi < y- (2.4) 

(iv) For any j = 1, m, > max/ij,i(r, ^j). ■ 

Remcirk 2.3 The condition (2.4) means that it is not free to make a circle of instan- 
taneous switchings. It is satisfied if for example for any i, j, hij{u!, t,y) — y — Cij{u!, t) 
with Cij{uj,t) >Q,\/t <T. n 

Our main result is: 
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Theorem 2.4 Assume Assumption 2.2 holds true. Then RBSDE (2.1) has at least 
one solution. 



Proof : We use Picard iteration. First let us denote: 

ij{t,y,z) = ^ni fj{t,^,z) and fj{t,y,z)= sup fj{t,^,z). 

y ■yj=y 'y'-yj=y 

By Assumption 2.2 (i) and (ii), fj, fj are uniformly Lipschitz continuous in (j/, z) and 

e[ j\%{t, 0, 0) |2 + 0, 0) I V^} < oo. 
Next, let (y^'°, be the solution to the following BSDE without reflection: 

Yi'' = + [lj{s, Yt\ Zi'')ds - j"^ Zi'^dB,, i = 1, • • • , m. (2.5) 

For j = 1, . . . ,m and n = 1, 2, ■ • •, recursively define Y^'^ via the following RBSDEs 
whose solution exits thanks to the result by El-Karoui et al. [15]: 

y/'" = P . - r Zl'^dBs + ir^'" - 

+ fj{s, Y,''--\ • • • , y/-^'"-\ , y/+^'"-^ • • • , yr"-\ zr)ds; (2.6) 

l^^> > max hj,,it, Yr-'y, [Yr - max hj,,it, Yr-')]dKt = 0. 

Note that, given Y'^''^~^, i = 1, • • • , m, for each j (2.6) is a one dimensional BSDE or 
reflected BSDE. Under Assumption 2.2, (2.6) has a unique solution. Moreover, by 
comparison theorem (see e.g. [15], Theorem 4.1.) it is obvious that Y^'^ > y^'°. Then 
by induction one can easily show that Y^'"' is increasing as n increases. 
In order to obtain uniform estimates of y^'", denote: 

A ™ A ™ 

i = Yl l^il fit^y,^) = H \fj{t,y,z)\- 

i=i i=i 
Let (y, Z) be the solution to the following BSDE: 

Yt = i+ r f{s,Z,Z,)ds- f ZsdBs. 
Jt Jt 



Denote, for = 1, • • • , m. 



y/ = y„ zi^Zt, Ki^o. 
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Obviously < F/. Note that (F^ K^) satisfies 

Jt Jt 
Yi > max F/) ; [F/ - max hj,,{t, Y;)]dKi = 0. 

Once more apply the comparison theorem repeatedly, we get 

Yr<yt, vn. 

Recall that F/'" > F/'°. Then 

V^l sup < C < oo, Vn. (2.7) 

j=l 0<t<T ^ 

Moreover, 

e{ sup |[max%(t,r/'"-^)] + |n<s{ sup llmaxr^-^in < C. 

This further implies that 

e{ £ \Zt?dt + < C, Vj, n. (2.8) 

Now let y-' denote the limit of F-''". By Peng's monotonic limit theorem [24] or 
[23], we know is an rcll process, and following similar arguments there one can 
easily show that there exist {Z\ K^) such that 

yi = + r fM y^s, zi)ds - r zidB, + A-^ - Ki- 

Jt Jt (2.9) 

r/ >max%(t,r/). 

Consider now the following RBSDEs whose solution exits thanks to the result by 
Hamadene [17] or Mingyu & Peng [23]: 

+ f,{s, F\ ■ ■ ■ , Yr\ r/, ■ ■ ■ , Zl)ds; (2.10) 
Yi > max/i,- ,(t, r/); [Yl - max/i,-,(t, Yl_)]dKi = 0. 

We note that (2.9) and (2.10) have the same lower barrier. Since y/ is the smallest 
/j-supermartingale with lower barrier max hj^i{t,Yi), we have F/ ^ F"' (see [23], 
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Theorem 2.1). On the other hand, since Y-l'"' ^ < for any (i,n — 1), by the 
monotonicity of hj^i we get 

max hj i{t, Yl'"'~^) < max hj^i{t, F/). 

Then once more by comparison theorem for RBSDEs we have Y^'^ < Y^ , which 
imphes that 1^ < Yf . Therefore, Y-f — Y"/. This further imphes that dt (8) dP- 
Zi = Zi and P-a.s. for any t < T, Kl = Kl, and that 

Yi = + j'^ fj(s, t,, Zi)ds - j'^ ZidBs + Ki- Ki- 
Yi > max 4(^, y:), [yl - max hj,iit, Yl)\dKi = 0.. 

Finally we show that Y^ is continuous. We first note that, by (2.11), AY/ = 
-AX/ < 0, and if AX/ ^ 0, then Y^_ = max%i(i, F^^). It is obvious that Y^ is 

continuous when Aj — 0. We now assume AF/^ ^ for some ji and t. Then 7^ 
and Ay/^ < 0. Note that in this case AX/^ > 0, which further imphes that 

y,i^ = max/i,,,,(i,y/_). 

Let j2 e Aj^ be the optimal index, then 

hn,nit,Yi!r) = Y^l > Y^ > max/i,,,,(i, F/) > F/^). 

Thus AF/^ < 0, and therefore Aj^ ^ 0. Repeat the arguments we obtain e ^j^.i 
and t^l^ < for any k. Since each j^. can take only values 1, • • • , m, we may assume, 
without loss of generality that ji = j^+i for some k > 2 (note again that ji ^ Aj^ 
and thus j2 7^ ii)- Then we have 

— ^h^hi^-i yi-)-i ■ ■ ■ ) yi- ^ = ^jk-i,3k{^i yi-)-i yi- — ^jkjii^^ yi-)- 

This contradicts with (2.4). Therefore, all processes Y^ are continuous. ■ 
By applying comparison theorem repeatedly, the following two results are direct 
consequence of Theorem 2.4, and their proofs are omitted. 

Corollary 2.5 The solution constructed in Theorem 2.4 is the minimum solution 
to (2.1). That is, if Y is another solution to (2.1), then F/ < F/, j = 1, • • • ,m. 
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Corollary 2.6 Assume {ij,fj) also satisfy Assumption 2.2, and 



Let and Y denote the solution to (2.1) constructed in Theorem 2.4, with coefficients 
i^j: fj: hj,i) and {^j, fj, hj^i), respectively. Then < F/, j = 1, • • • , m. 



We now turn to the system (1.7) and we have: 

Theorem 2.7 The system of reflected BSDEs (1.7) has a unique solution. 

Proof: Existence is an immediate consequence of Theorem 2.4 through the properties 
satisfied by ipi, 1^2, ^1, <f2 and finally H* which make Assumptions 2.2 fulfilled, 
especially the fact that Lpi{t,x) + Lp2{t,x) > for any (t,x). Uniqueness of Yq comes 
from Theorem 1.3. Similarly one can prove the uniqueness of {Y^^, Y^). Uniqueness of 
Z^, Z"^ is a consequence of Doob-Meyer Decomposition, therefore we have thoroughly 
uniqueness of and K'^. ■ 

Another by-product of Theorem 2.4 is that it provides also existence of a solution 
of the system (2.1) considered between two stopping times. This result is in particular 
useful to show uniqueness of (2.1). 

Actually let Ai and A2 be two stopping times such that P-a.s., < Ai < A2 < T" 
and let us consider the following RBSDE over [Ai, A2]: for j = 1, ■ ■ ■ , m, P-a.s., 

(^/)te[Ai,A2] continuous, {K^t^^XiM] continuous and nondecreasing. 



Yt' = + fjis, y's, Zl)ds - ZldB, + Kl - Kl, yt e [Ai, A2] ; 



Kl^O,B,ndE{ sup \Zi\^ds + {Kif}< 00; 




(2.12) 




Then we have: 



Theorem 2.8 ; Assume Assumption 2.2 holds true and that for j — 1, ...,m, e 
J^X2 ^'^^ satisfies: 



mif} < 00 and > rnax%(A2,4). (2.13) 



Then the RBSDE (2.12) has a solution. 
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3 Uniqueness 



We now focus on uniqueness of the solution of RBSDE (2.12), hence that of RBSDE 
(2.1). To do that we need a stronger assumption. 

Assumption 3.1 (i) fj is uniformly Lipschitz continuous in all t/i. 
(a) If i e Aj,k e Ai, then k & Aj U {j}. Moreover, 

hj,i(t, hi,k(t, y)) < hj,k(t, y). (3.1) 

(Hi) For any i & Aj, 

\hj,iit,yi) - hj,i{t,y2)\ < \yi - y2\- (3.2) 

Note that these assumptions are satisfied if = {1, . . . , m} — {j} for any j = 1, m 
and hij{uj, t,y) = y — Cij{uj, t) with Cjj(a;, t) > for any t <T, P-a.s. 

Theorem 3.2 (Uniqueness) 

(i) Assume Assumptions 2.2 and 3.1 are in force. Then the solution to (2.12) is 
unique. 

(a) Moreover, assume for j — 1, . . . ,m, fj satisfies Assumptions 2.2 and 3.1, and 
satisfies (2.13). Let {Y\Z^) he the solution to RBSDE (2.12) corresponding to 
(fj^ii^)- For j ^l,...,m, denote, 

m 

AF/^F/-F/, Aa = a-el, ||A/t||=E sup |[/,-/,](t,y,;^)|. (3.3) 

Then there exists a constant C, which is independent o/Ai, A2, such that: 

max lAy/j^ < £;,,{e^(^-^^) max lA^i/ + C \\Aftfdt}. (3.4) 

The proof wiU be obtained after intermediary results. However basically it uses 
an induction argument and a characterization of as a supremum over strategies 8 
of some processes r^'^ which are uniquely defined. 

So assume Assumptions 2.2 and 3.1 hold. Let denote the number of nonempty 
sets Aj in (2.12), that is, the number of reflections in (2.12). We proceed by induction 
on [I. First, when = 0, (2.12) becomes an m-dimensional BSDE without reflection. 
By standard arguments one can easily show that Theorem 3.2 holds true. Now assume 
it is true for // = mi — 1 for some \ <m\ <m. For /i — mi, let {Y^ , , K^) be an 
arbitrary solution to (2.12). 
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3.1 Admissible strategies 

We want to extend the arguments in Theorem 1.3 to this case. The idea is to express 
as the supremum of Y^'^ , where 5 is an admissible strategy which we are going to 

define soon, and Y^'^ is the solution to a system of RBSDEs with mi — 1 reflections. 

Thus by induction Y^'^ is unique for each (j, 5) and therefore Y^ is unique. 

To motivate the definition of admissible strategy, we heuristically discuss how to 

find the "optimal strategy", an analogue of the r* in Theorem 1.3. A rigorous and 

more detailed argument will be given in §3.3. 

Let Tq = Ai, and without loss of generality assume Ai ^ 0. Set 

T* = \ui{t > To : Y^ = max/ii,i(i, Y^)} A A2. 

When tI < A2, we have 

Yl = m8Lx/ii,i(Ti*,y;*). 

That is, there exists an index, denoted as rji G vli, such that 

So, besides the stopping time t^* , we need to keep track of the "optimal index" 771. At 
this point, let us denote 770 = 1- Note that, over [to,t*], it holds that: 

y/ = y/. + £ fj{s, t,, Zi)ds - £ ZldB, + Ki. - Ki, j ^ rjo; 
< y/ > max hj,k{t, [Yi - max hj,k{t, Y,^)\dK^ = 0, j ^ ^0; 

_ Y,^^ = y;i° + f^' f,,{s, t,, Zf)ds - ZfdBs. 

This is a system with only mi — 1 refiections. 

Now for [r^.Tji)^ we need to consider two different cases. 

Case 1 . Assume A^-^ ^ 0. Then by considering Y'^'^ over [r*, A2] instead of y* over 
[to,A2], similarly one can define and 772 G A^^, and see that satisfies a system 
with mi — 1 refiections over [Ti,r2], where the 7/1-th equation has no reficction. 

Case 2 . Assume = 0. In this case, the 771-th equation has no reficction. Note 
that y^? = /i'^rto,»;i(T"r, Yt*)- Choose r| "close" to Ti , then for any t G [tI, r^], we have 
Yl"" fa hrjo,ni{ri, Yt"^'). On the other hand, by (3.1) one can see that y/* > hj^r^oijl, Y^S) 
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for any j such that tiq G Aj. Since is close to r^, let us assume Y"/ > hj^r^oi^'i-i 
for t e [t;^,T2]. So approximately, over [Tj*,T|], F-^, j 7^ r^o satisfy 

I r/ ^ + h,,,,{Tl Y:n, Yl Y:\ Z^ds - fj' ZldB, + Ki. - Kl- 

Yi > max * Y^)- [F/ - max Y^)\dK\ = 0. 

/C 6 A J— -[770/ "^£-^j*~i^O/ 

This is a system of m — 1 equations with mi — 1 reflections, where we remove the 
equation for y° completely. 

In order to move forward, we need to define ri2 so that 7^ 0. It turns out that 
the best way is to set 772 = tiq. Then we can continue the procedure. 

Based on the above argument, let us introduce the following: 

Definition 3.3 5 = (tq, • • • , r^; r/o, ■ ' ' ? ''7n) is called an admissible strategy if 
(i) \i = tq < ■ ■ ■ < Tn < \2 is a sequence of stopping times; 
(a) r]o, ■ ■ ■ ,r]n are random index taking value in {!,■■■ , m} such that rji e J-n,' 

(Hi) A^, ^ 0; 

(iv) If Arj^ ^ 0, then r]i+i e A^.; 

(v) Ar^^ = 0, then r]i+i = r]i-i. 

Remark 3.4 By Definition 3.3 (Hi), A^. = implies that i > 1. Then (v) makes 
sense. Moreover, in this case A^.^^ = A^._-^ ^ 0. 

3.2 Construction of 

For an admissible strategy 6, we construct {Y^'^ , Z^'^) as follows. First, for t G [r^, A2] 
and j = 1, ■ ■ ■ ,m, set 

= (3.5) 

where {Y^'^,Z^'^) is the solution to (2.12) constructed in §2. Then in particular we 
have 

y4;^'>max/i,-,(T„,y4;0, i = l,---,m. (3.6) 

For i = n — 1, ■ ■ ■ ,0, assume we have constructed Y.^^^^_ for j = 1, ■ ■ ■ ,m, which 
we will do later. Note that Y^'^ may be discontinuous at Tj+i. We define {Y^'^,Z^'^) 
over [Ti,Ti+i) in two cases. 
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Case 1 . If ^ 0, assume, 

Y^:l^_ > max hj^k {Ti+i , r^fi -), Jj^Vi- (3-7) 
We consider the following RBSDE by removing the constraint of the rji-th equation: 

< y/'^' > max hj,,{t, y/''^); [y/'^' - max h.^J, Y,'''')]dK'/ = 0, Vf, 
Yf"' = y^V + Ui-S: K Z'/'^)ds - Z'/"dBs. 

(3.8) 

It is obvious that the fj,hj^i,Aj here satisfy Assumptions 2.2 and 3.1. Since (3.8) 
has only rrii — 1 reflections, by induction (3.8) has a unique solution {Y^'^ , Z^'^),j = 
1, • • • ,m over [ri,Ti+i). □ 

Case 2 . If = 0, by Remark 3.4 we have i > 1 and A^^_^ ^ 0. Assume 

Y^f > max /ij,fe(ri+i,y4f,_), j ^ Vi-i- (3-9) 

We now omit the rji^i-th equation and consider the following m — 1 dimensional 
RBSDE with at most mi — 1 reflections: for j ^ fji-i, 

' Yt' = Y^:l_ - Zl^^dB, + K^^_^ - Kf^ 

< + /,(s, y/'\ ■ ■ ■ , y/'^^^-i-i, y;VK+i-i, . . . , y/.™, zl'^)ds- (3.10) 
y/'^- > max h,,,{t, y/''^), [y/'^- - max h,,,{t, Y,'^')]dKf' = 0. 

Here: 

/i(i, 1/1, • ■ • , l/r?,_i-l, l/r?i_i+l, ■■■,yn,z) (3.11) 
~ l/l, ■ ■ ■ 5 Vvi-i-^i ^Vi-ijVii'^i^ Vrii)-! Urii-i+li ' ' ' ■> Vni ^)- 

One can easily check that fj,hj^i,Aj — {rji-i} here satisfy Assumptions 2.2 and 3.1. 
Since (3.10) has at most mi — 1 reflections, by induction (3.10) has a unique solution 

(Y''^, Z''^),j ri^.i, over [r„r,+i).n 

It remains to construct Y^^^^_ satisfying (3.7) or (3.9). First, if i + 1 — n, set 
= ; and if r,+i = A2, set Y^f^^ = ^1,- By (3.5) and (2.13) we know both 



25 



(3.7) and (3.9) hold true. Now assume i < n — 1 and Tj+i < A2. Assume we have 
solved either (3.8) or (3.10) over [Tj+i,Tj+2)- 

Case 2 . Assume ^4^. = 0. By Remark 3.4 we know i > 1, ?7i+i = ?7i-i, and A^^^^^ ^ 0. 
Then we obtain Y^f^^ from (3.8) over [Tj+i,Ti+2) satisfying: 

> h,,,{n+^, F4\), j ^ = r;,_i. (3.12) 

Define 

Y:ii,_^Y:^i^, j^vi-i- (3.13) 

Then (3.9) follows immediately from (3.12). □ 
Case 1 . Assume A^. ^ 0. We further discuss two cases. 

Case 1.1 . Assume A^^+i = 0. Then we obtain Y^^^^,j ^ rji from (3.10) over [tj+i, Ti+2) 
satisfying 

Y^i^ > max h,4n+,, Y^il), j ^ rj,. (3.14) 

Define 

Yii,.^Yii^, 2 + Yi::i- = K.,,,,,iT.+„Yi:^'). (3.15) 

By (3.14), to prove (3.7) it suffices to show that 

Y^i, > %..(t.+i, (r.+i, f4^;+^)), if T), e A,. (3.16) 

By (3.1), we have 

When rji e Aj, by Assumption 3.1 (ii), we have 77^+1 e [Aj — {rji}] U {j}. If 77j+i e 
Aj - {rji}, then (3.16) follows (3.14). If 77^+1 = j, then (3.16) follows (2.2). So in both 
cases (3.16) holds true, then so does (3.7). □ 
Case 1.2 . Assume A^.^^ ^ 0. Then we obtain Y^^^^ from (3.8) over [tj+i, Tj -1-2) 
satisfying: 

> max/i,.,(T,+i,y4^J, i ^ 77,+!. (3.17) 

Define 

n^r- = n!f:- V max (r,+i, y^fj; (3.I8) 



26 



We now check (3.7) for j ^ rji. First, for j = rji+i, by (3.18), 

Moreover, if rji G ^j^i+i, by (3.1) and (2.2) we have 

So (3.7) holds true for j — 77^+1. 

Next, assume j ^ rji, rji+i, by (3.17) and the first hne in (3.18) we have 

Yil,_ > max h,4n+„ f4V)- (3-19) 

"^fcj^j "I'/i j^+l / 

If r]i+i e Aj, recall the definition of Y^:^it} in (3.18). First, by (3.17) we have 
Second, for any k G ^r;i+i ~ {^i}) similar to (3.16) one can easily prove 
Thus 

hj,,^^,{ri^„Yi:^)<Yii,_. (3.20) 

Finally, if rji G Aj, since rji+i G A^^, by Assumption 3.1 (ii) we have rji+i G Aj\J{j}. 
Then by (3.20) and (2.4) we have 



This, together with (3.19) and (3.20), proves (3.7) for j ^ rji,rji+i. □ 

Now for each i, either (3.8) or (3.10) is well defined. Therefore, over each [r^, r^+i), 
either (3.8) or (3.10) is wellposed. By applying Corollary 2.6 and comparison theorem 
repeatedly, one can easily show that: 

Lemma 3.5 For any admissible strategy 6 and any j, we have F/'-' < F/ whenever 
F/'-' is well defined. ■ 
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3.3 Verification Theorem 



Moreover, we have : 

Theorem 3.6 For j = 1, ■ ■ ■ ,m, we have = esssup Y^f . 

5 

Proof. Fix e > and let = {ie : i = 0,1,---}. Wc construct an approximately 
optimal admissible strategy 5 = 6^ as follows. First, let Tq = Ai and choose rjQ such 
that Ajj^ ^ 0. For i = 0, 1, ■ ■ ■, we define (tj+i, ?7j+i) in two cases. 

Case 1 . If 7^ 0, set 

n+i = inf{t > n ■■ Yt' = max Y,^)} A As. 

If Tj+i < A2, set 77j+i e A^. be the smallest index such that 

y^,-K^.,M+i.y:!t:^)- (3.21) 

Otherwise choose arbitrary r^j+i G A^. . 

Case 2 . If A^. = 0, since A,^^ ^ 0, we have i > 1. Set 77^+1 = r^j-i. If Tj = A2, define 
Tj+i = A2. Now assume Tj < A2. It is more involved to define Tj+i in this case. By 
the definition of 77^, one can check that in this case we must have A^^.^ 7^ 0, and thus 
by Case 1, 77^ e and 

We claim that, for any j such that ?7i_i e A^, 

l^>/i,,,,_,(7^,l^-^). (3.22) 
In fact, if not, by Assumption 3.1 (ii), r]i e Aj U {j} and 

This contradicts with (2.3). We now define 

A I 2 

Ti+i = Tj+i Ar^+i A A2; 
where r/^_^ is the smallest number in such that r/^^ > Tj; and 

rl, = inf{i > n : s.t. rji^i e Aj,Y,^ = /i,-,,_,(i, y,"-^)}. 
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We claim that, for a.s. tu, r„ = A2 for n large enough. In fact, if r„ < A2 for 



all n, let t^o = lim r„. In Case 1, (3.21) holds true. In Case 2, if Tj+i = r/_,_]^, then 
Tj+i e ; and if Tj+i = r^^^, then there exists 7)1+1 such that rji-i e and 

y^-K^.,,..M^,.Y:!^^). (3.23) 

Since < 00 for all i, there can be only finitely many i such that Tj+i G -D^. Therefore, 
there exists some no such that for all i > no, either (3.21) or (3.23) holds true. The 
vector (?7j_|_i, 77j_i, T^i) can take only finitely many values, then there exist (ji,j2,j3) 
and an infinite sequence of such that j2 G ^jnJs ^ 

By (3.23) and (3.21) we get 

Send A; — >• 00, we have 

y^'i — h- ■ (r Y^^ ) Y^^ —h ■ (t Y^^ ) 

Too "'31,J2\'0C1 Toofl Too "'J2,33\ ' 001 Too ^ ' 

Then, by Assumption 3.1 (ii), J3 e Aj^^ U{ii} and 

■^rd ~ ^ji ,32 ("^oo ) hj^ (Too , ) ) < /ijj (Too , ) . 

This contradicts with (2.3). Therefore, Tn = X2 for n large enough. 

We now set 5"'^ = (tq, ■ ■ ■ , r„; 770, ■ ■ ■ , ?7„). Recall Definition 3.3. One can easily 
check that S""'"^ is an admissible strategy. Denote 



Ay/ = y/ - y/"'''^ 



If i + 1 = n, it is obvious that 



K+.-^::^i = iAi^,j. (3.24) 

We now assume i + 1 < n. 
Case 1 . Note that (F^ , K^) satisfies 

< 1^^' > max h,4t, Y,'); [F/ - max /i,,fc(t, F,'=)]ciirf = 0, (3.25) 
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max \Yl^^ - Y;.;'1\ = max \AYI^^ |; 



Compare (3.25) and (3.8). By induction we have 

^n^lAl^r < -<:^r}- (3-26) 

If Tj+i = A2, then 

l>^,.-<:^l = iei,-eiJ=0, V7. (3.27) 

Assume Tj+i < A2. Note that is defined by either (3.15) or (3.18). In the 

former case, by (3.2) we have 

1+1- I 

Then 

max \Yl , - Y^'^'i] < max IAF/ , 1. (3.28) 
In the latter case, recalling Lemma 3.5 and (3.1), we have 
max \Yj -V^"''f|= max \AY^ 1; 

l-'ri+i -'-Ti+i- I ^ l^-'ri+i h 

< |y%+l _y5"'''-%+l| / |Ay%+i| 
— l-'Ti+i -'Ti+i- I — l^-'Ti+i r 

Thus (3.28) also holds true. Therefore, in all the cases we get 

m^ \AY^f < £;,ie^(^'+-^')max|Ar4jn. (3.29) 
Case 2 . Note that (F^ , K^),j ^ r7i_i satisfies 



+ ^ /,-(s, • . • , • • • , y^, (3.30) 

y/ > max /I,- ,(t, y,^); [F/ - max /.,,,(t, y,'=)]ciKf = 0; 



where 



/i(^, 1/1, • • • , ■■■,yn,z) (3.31) 

= /i(^, yi, ■ ■ ■ , ■ ■ ■ , 1/n, ^) + ; 

li^f,{t,tt,Zi) (3.32) 

. . . v'^'-i"^ h (t- V'^*') V^i-^+^ . . . 
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We note that here is considered as a random coefficient. Compare (3.30) and 
(3.10). RecaUing (3.13), by induction we get 

max lAy^^f < £;^.|e^(^'+i-^') max |Ay/ T + CV T^Vt M^- (3-33) 
Note that = Vi,^i(^i>^r?)- Then 



< c 



Vi-l 



n 



m 



<CY.\Y,'-Y,f. 

k=l 



(3.34) 



Note that in this case Tj+i — Tj < s. Then 

m 

\li\<CY: sup \Y,1-Y>;\'^I,. 

l^—l Xl<tl<t2<\2-t2—tl<£ 

Thus (3.33) imphes 

inax \AYl\' < Eje^^^'^^-^'^ max {AY^J^ + 7,[r,+i - n]}. (3.35) 

Now given A^. ^ 0, if ^^.^^ = 0, by (3.29) and (3.35) we have 

max |A17j2 < £;,,{e^(-^+-->) max \AY^^J + 7,[r,+2 - t,+i]}. (3.36) 

By Definition 3.3 (v), we have Ar^^^^ ^ 0. Therefore, if A,^- ^ 0, then cither A^^^^ ^ 
and (3.29) holds true, or A^^^^^ ^ and (3.36) holds true. Since A^^ ^ 0, one gets 
immediately that 

max \AYlf < CE^A max lAF/ 1^ + I,] = CE^A max \Y^'^ - Y^ P + lA. 
First send n — >• oo. Since t„ ^ A2, we get 

Tn SA2' Tn >>\2' 

By Dominating Convergence Theorem we have 

Now send £ — > 0. Since is continuous, by Dominating Convergence Theorem again 
we get 

This proves the theorem. 



\imE^,{Q^O. 

n—^oo 
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3.4 Proof of Theorem 3.2 



As mentioned before, we prove the theorem by induction. Assume Theorem 3.2 holds 
true ior II — mi — 1. Now assume /i — mi. 

(i) By Theorem 3.6, Y^^ is unique. Similarly y/ is unique for any t E [Ai, A2]. By 
the uniqueness of the Doob-Meyer decomposition we get is unique, which further 
implies the uniqueness of immediately. 

(ii) For any admissible strategy S, define Y^'^ similarly and denote 

If Ajj. 7^ 0, recalling (3.8), (3.15), and (3.18), by induction we have: 

max lAK^'^f < £;^.(e^(^'+i-^') max \AYI'\ P + C T^' IIA/JPrfij- 

l<j<m. » ' I- j^r]i '+1 Jn ^ 

If Ajj. — 0, recalling (3.10) and (3.13), by induction we have: 

max lAK^'^f < E^ie^^^'+i"^^) max lAK^'^' P + C /"'^' \\Aftfdt]. 
Put together and note that A^^ 7^ 0, we get: 

max \AY^f\'<Eje^^'^-'^\m^ lA^f + C \\Af,rdt}. 

l<j<m >- i<J<m ^ 7Ai 

Then (ii) follows from Theorem 3.6 immediately. ■ 
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